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Abstract 

In this paper, we investigate the distributed shortest distance optimization prob¬ 
lem for a multi-agent network to cooperatively minimize the sum of the quadratic 
distances from some convex sets, where each set is only associated with one agent. 

To deal with the optimization problem with projection uncertainties, we propose 
a distributed continuous-time dynamical protocol based on a new concept of ap¬ 
proximate projection. Here each agent can only obtain an approximate projection 
point on the boundary of its convex set, and communicate with its neighbors over 
a time-varying communication graph. First, we show that no matter how large the 
approximate angle is, the system states are always bounded for any initial condi¬ 
tion, and uniformly bounded with respect to all initial conditions if the inferior limit 
of the stepsize is greater than zero. Then, in the two cases, nonempty intersection 
and empty intersection of convex sets, we provide stepsize and approximate angle 
conditions to ensure the optimal convergence, respectively. Moreover, we give some 
characterizations about the optimal solutions for the empty intersection case and 
also present the convergence error between agents’ estimates and the optimal point 
in the case of constant stepsizes and approximate angles. 

Keywords: distributed optimization; convex intersection; shortest distance optimiza¬ 
tion; approximate projection 

1 Introduction 

In recent years, distributed optimization of a sum of convex functions has attracted much 
attention due to its wide applications in resource allocation, source localization, and robust 
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estimation (referring to [5, 19, 20, 21, 23, 28, 29, 30]). A whole optimization task can be 
accomplished cooperatively by a group of autonomous agents via simple local information 
exchange and distributed protocol design even when the communication graph among 
agents is time-varying. 

Although many existing distributed optimization works have been done by discrete¬ 
time algorithms, more and more attention has been paid to continuous-time algorithms 
in recent years [18, 31, 32, 33, 34, 35, 36], partially because the continuous-time models 
can be studied by various well-developed continuous-time methods or make the algorithms 
easily implemented in physical systems. A distributed continuous-time computation model 
was proposed to solve an optimization problem for a hxed undirected graph in [31], with 
the optimization achieved by controlling the sum of subgradients of convex functions to 
make the state enter the optimal solution set, and later this model was generalized to 
the weight balanced graph case in [33], for differentiable objective functions with globally 
Lipschitz continuous gradient. Another continuous-time distributed algorithm with con¬ 
stant stepsize was developed in [35] for optimization problems with positivity constraints 
in a hxed undirected graph case, where a lower bound of convergence rate and an upper 
bound on the agents’ estimate error were presented. Moreover, the relationship between 
the existing dual decomposition and consensus-based methods for distributed optimiza¬ 
tion was revealed in [36], where both approaches were based on the subgradient method, 
but one with a proportional control term and the other with an integral control term. 

When the optimal solution sets of agents’ individual objective functions have a nonempty 
intersection, the distributed optimization problem is equivalent to the convex intersection 
problems (CIP) [11, 12, 14, 15, 17, 18, 20]. A projected consensus algorithm was proposed 
in [20] for a network to solve the CIP, and the authors showed that all agents converge to a 
common point in the intersection set for weight-balanced and jointly connected communi¬ 
cation graphs. Later, a continuous-time dynamical system was designed and connectivity 
conditions were discussed for the optimal convergence in [18]. In addition, a random sleep 
algorithm was proposed with providing conditions to converge almost surely to a com¬ 
mon point in the intersection set in [14], where agents randomly take the neighbor-based 
average or projection onto their individual sets based on a Bernoulli process. Almost all 
the existing optimization results were obtained based on the assumption that the exact 
projection point onto the convex sets can be obtained [11, 12, 17, 18, 20, 22, 27]. 

On the other hand, the intersection of the considered convex sets may be empty in 
practice. In this case, how to seek a point with the shortest (quadratic) distance to these 
sets is also important. For instance, the supply center location problem is concerned with 
how to seek the location of raw materials supply center so that the average transportation 
cost from the supply center to the multiple factories is minimal ([9, 10]); the source 
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localization in a sensor network is related to estimate the location of the source emitting 
a signal based on the received signals of multiple sensors in a noisy environment ([4, 27]). 
In fact, the problem for both the empty and nonempty intersection case is referred to 
as the shortest distance optimization problem (SDOP). Obviously, CIP is a special case 
of SDOP, and the average consensus problem is also a special case of SDOP since the 
optimal solution of the minimum of the sum of quadratic functions from some points is 
exactly the average of these points. Some distributed algorithms were proposed to discuss 
SDOP. For example, [27] formulated the source localization problem as the SDOP in a 
plane and proposed a discrete-time distributed algorithm, with the adjacency matrices 
of communication graphs required to be doubly stochastic. Moreover, [22] proposed two 
distributed continuous-time algorithms to solve SDOP in the empty intersection case 
for connected graphs: the hrst one was designed for optimal consensus based on sign 
functions, and the second one was modihed to avoid chattering but only to achieve the 
optimal consensus approximately. 

The objective of this paper is to design a continuous-time distributed protocol to 
solve SDOP based on approximate projection. Note that the exact projection is usually 
hard to obtain in practice. Therefore, approximate projection may have to be discussed 
in different situations, and, in fact, [15] proposed a discrete-time approximate projected 
consensus algorithm to solve CIP. The motivation of the current research aims at analysis 
and distributed design to cooperatively solve SDOP with projection uncertainties and 
continuous-time dynamics. For example, in a practical robotic network to solve the SDOP, 
a continuous-time robot may not always obtain the exact projection point of its own 
convex set, but only spot some point on the set surface near the exact projection point. 
The contribution of this paper can be summarized as follows. 

• We propose a new concept of approximate projection, which is related to some 
points on the convex set’s boundary surface and close to the exact projection point 
when the exact projection is hard to obtain. In other words, we consider an approx¬ 
imate projection related to set boundary surfaces, different from that dehned in a 
“triangle” in [15]. To overcome the analysis difficulties resulting from this new ap¬ 
proximate projection, we employ a geometric method to convert the original problem 
to a heterogeneous stepsize problem. 

• Given any approximate angle, we show that, with the proposed continuous-time 
algorithm, the agent states are always bounded for any initial condition, and uni¬ 
formly bounded with respect to all initial conditions if the stepsize is not too small. 
The result with respect to the continuous-time algorithm is different from some 
results based on some discrete-time ones. In fact, vr/d was shown to be the criti¬ 
cal approximate angle for the boundedness of the discrete-time algorithm with the 


3 



Lou et al. Distributed Continuous-time Approximate Projection Protocols 


approximate projection defined in a triangle in [15]. 

• We study SDOP in both the nonempty and empty intersection cases, and propose 
a unihed protocol based on the approximate projection. In fact, the proposed con¬ 
vergence conditions and proofs in the two cases are quite different. Note that our 
result is different from that in [22] because we handle approximate projections with¬ 
out assuming that the communication graph is always connected, and ours tackles 
both the nonempty and empty intersection cases, while [15] only does the nonempty 
intersection case. Moreover, we also discuss the convergence error between agents’ 
estimates and the optimal point in the case of constant stepsizes and approximate 
angles. Our results are certainly consistent with those discrete-time algorithms in 
the literature such as [19, 20] based on the exact projection. 

The paper is organized as follows. Section 2 shows some basic concepts and prelim¬ 
inary results. Section 3 dehnes an approximate projection concept and formulates our 
shortest distance optimization problem (SDOP), followed by Section 4 for the discus¬ 
sions on boundedness and stepsizes. Section 5 presents the main convergence results for 
the nonempty intersection case, while Section 6 for the empty intersection case. Section 
7 discusses the constant stepsize and approximate angle case. Then Section 8 provides 
numerical simulations. Finally, Section 9 gives some concluding remarks. 

Notations: ® denotes the Kronecker product; 1 denotes the vector with all ones; (^)p- 
denotes the f-th row and j-th column entry of matrix A; y'^ denotes the transpose of 
a vector y G M™; \y\ denotes the Euclidean norm of y] [v,z\ denotes the line segment 
connecting the two points n, 2 ;; line(n, z) denotes the line passing the two points v, z; for 
a set K C MP, int(iF) and bd(JF) = JF\int(iF) denote the sets of interior points and 
boundary points of K, respectively; for a closed convex set K C M"*, Pk{-) denotes the 
projection operator onto K; \y\K '■= \y — PK{y)\ denotes the distance between y and K; 
(•, •) denotes the Euclidean inner product in M™; the angle between nonzero vectors y 
and is denoted as Z{y,z) G [0,7r], where cos Z{y,z) = {y, z)/{\y\\z\); spanjui, ..., Up} 
(aff{ni, ...,Vp}) denotes the subspace (affine hull) generated by vectors ui, ...,Vp. 

2 Preliminaries 

In this section, we give preliminaries on graph theory [1], convex analysis [2], the consensus 
model with disturbances [26]. 
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2.1 Graph Theory 

A multi-agent network can be described by a directed graph Q = (V,£^), where V = 
{1,2, is the node (or agent) set and C V x V the arc set with the arc (j, i) G S 
describing that node i can receive the information of node j. Here {i,i) ^ ^ for all i. Let 
Afi = {j G V\{j,i) £ he the set of neighbors of node i. A path from node i to node 
j in ^ is a sequence (i,ii)j ■■■, ('lp,j) of arcs in L. Graph ^ is said to be strongly 

connected if there exists a path from i to j for each pair of nodes i,j G V. Graph 0 is 
undirected when (j,i) G if and only if (i,j) G L. 

The communication over the network under consideration is switching and character¬ 
ized by a directed graph process Qcr(t) = (V, Sa{t)),t > 0, with Srj(t) the arc set of the graph 
at time t. Here a : [0, oo) —?■ Q is a piecewise constant function to describe the time-varying 
graph process, where Q is the index set of all possible graphs on V. Let A := {tk, A; > 0} 
with to = 0 denote the set of all switching moments of switching graph As usual, we 
assume there is a dwell time r > 0 between two consecutive graph switching moments, 
i.e., tfc+i — tfc > r for all k. The switching graph is uniformly jointly strongly connected 
(UJSG) if there exists T > 0 such that the union graph (V, is strongly 

connected for t > 0. 

2.2 Convex Analysis 

A set -A C is convex if Xzi -l- (1 — X)z 2 G K for any zi,Z 2 ^ K and 0 < A < 1. For a 
closed convex set K in R™', we can associate with any G R™ a unique element Pk{z) G K 
satisfying jz — Pk{z)\ = inf^g^^ \z — y\ =: |x|x, where Pk is called the projection operator 
onto K. We have the following properties for the projection operator Pk- 

Lemma 2.1 Let K be a closed convex set in R”^. Then 

{i) {y - Pxiy), z - Pxiy)) < 0 for any y and z E K] 

{ii) \PK{y) — z\ <\y — z\ for any y G R”^ and any z E K; 

(in) {y - Pxiy), z-y) < \y\Ki\z\K - bk) for any y and z] 

{iv) iPxiy) - Pk{z)\ <\y- z\ for any y and z. 

Proof, (i) is an equivalent dehnition of convex projection; (ii) comes from Lemma 1 
(b) in [20]. We now show (iii). First of all, {y — Pxiy), Pk{z) — PK{y)) < 0 by (i). It is 
also clear that {y — Pxiy), z — Pk{z)) < Then 

{y - PKiy), z-y) = {y- PKiy), z - Pk{z) + Pk{z) - PKiy) + Pxiy) - y) 

< \y\K\z\K - \y\l:- 
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Thus, the inequality (iii) follows, (iv) is the standard non-expansive property. □ 

The following lemma characterizes the distance between convex sets and their nonempty 
intersection, which can be found from Proposition 5.6.1 on page 72 in [ 6 ]. 

Lemma 2.2 Let iPi,...,iP„ be closed convex sets in M"*. If f]'^^^int{Ki) ^ 0, then for 
every bounded set S, there exists ^5 > 0 such that 

rr- < niax \x\\.'ix G S. 

The following lemma can be found from Proposition 1 on page 24 in [3]. 

Lemma 2.3 Let K be a closed convex set in Then \xW- is continuously differentiable 
and 

V\x\% = 2{x - Pk{x)). 


A function ip{-) : ^ M is said to be convex if ip{Xzi + (1 — X)z 2 ) < X^{zi) + (1 — 

X)ip{z 2 ) for any Zi, Z 2 G and 0 < A < 1, and it is Astrongly convex if ip{Xzi-\-{l—X)z 2 ) < 
Xip{zi) + (1 — X)y:>{z 2 ) — \iX{l — A)| 2 ;i — 2 : 2 ^ for any ^ 1,^2 £ and 0 < A < 1. The 
following two inequalities hold for a continuously differentiable convex and Astrongly 
convex function 99 , respectively: 


T{y) > t{x) + {y-x, V(^(x)), Vx, y G M™, (1) 

piy) > t{.x) + (y-x, V</9(x)) + ^||/-x|^Vx,|/ G M™. (2) 

The upper Dini derivative of function : (a, 5) —?■ M at t G (a, b) is dehned as 

n+ V 9 {t + s) -g{t) 

D g\t) = hmsup-. 

s^0+ ^ 

g is non-increasing on {a,b) if D^g{t) < 0,Vf G {a,b). The following result was shown in 

[ 8 ]. 


Lemma 2.4 Let gi{t,x) : M x M"* —)■ M, i = l,...,n be continuously differentiable 
and g(t,x) = maxi<i<ngi{t,x). Then D~^g(t,x(t)) = ma.Xi^x{t) gi(t,x(t)) with I ft) = 
{i\gi{t,x{t)) = g{t,x{t)), 1 < i < n]. 


2.3 Consensus 

Consider the following consensus model with disturbance Wi, 

Zi{t) = {zj{t)-Zi{t))-IWi{t), i = l,...,n, (3) 

ieM(i) 
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where the disturbance Wi{t) : [0, cxo) —)■ R is continuous. System (3) has a continuous 
solution, which satishes (3) for almost all t except at the switching moments of switching 
graph Consensus is said to be achieved for system (3) if for any initial condition, 
linit^oo ~ = 0 for all I < i, j < n. 

The next two lemmas can be obtained from the proofs of Theorem 4.2 and Proposition 
4.10 in [26], respectively. 

Lemma 2.5 If the switching graph is UJSC for system (3), then there exist 0 < /5 < 1 
and Bq, Bi > 0 such that 





I 


H{t) < H{kBo) + Bi 


max \wi(t)\dt, \/t : kBo <t<{k-\- l)Bo, 


where H{t) = maxi<jj<„ \Ziit) - Zj{t)\. 

Lemma 2.6 Suppose the switching graph Q„ of system (3) is UJSC and linit^oo= 0 
for all i. Then consensus is achieved for system (3). 

In the following consensus analysis, we need to extend the standard Barbalat’s Lemma 
to switching cases. A function g : [0, oo) —)■ R is uniformly continuous with respect to time 
intervals (s*,, s^+i), s > 0 with Sk+i—Sk > v for some n > 0, if, for any £ > 0, there is 5 > 0, 
which depends on {sfc}A;>o and g, such that, for any k and ri, r2 with Sk < ri < r^ < Sfc+i, 
^ when |r 2 — ri\ <6. We now introduce an extended Babalat’s Lemma, 
which can be found in [16]. 

Lemma 2.7 For a continuous function g, supposeYmvt^oo = do exists and g is contin¬ 
uously differential on each interval {sk,Sk+i), whose derivative g is uniformly continuous 
with respect to time intervals {sk,Sk+i) for k>t). Then limt^oo.^(^) = 0. 

3 Approximate Projection and Problem Formulation 

In this section, we introduce the distributed SDOP and the distributed continuous-time 
approximate projected algorithm. 

Consider a network of n agents (or nodes) and bounded closed convex sets W C R™- 
for i = l,...,n, with Xj only associated with (or known by) agent i. The goal of the 
network is to cooperatively hnd a point x* with the shortest quadratic distance from the 
n closed convex sets: 


n 


X* G argmin /(x). 



( 4 ) 
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Projection-based methods have been widely adopted in the literature to solve CIP 
and constrained optimization problems, and almost all methods require that the exact 
projection can be obtained [6, 17, 18, 20, 22, 23, 27]. Since the exact projection may 
be difficult to obtain in practice, each agent may only obtain an approximate projection 
point located on the convex set surface and near the exact projection point. To be strict, 
we give the following definition. 

Definition 3.1 Let 0 < 6 < 71/2 and K be a closed convex set in M"*. Define sets 

Cxiv, 9) = V -\- [z\ {z, Pk{v) — v) > kl cos 0}, 
b(n, K) = i^z\z G bd{K), [n, z] n bd{K) = 

The approximate projection P'fi{v,6) of point v onto K is defined as the following set: 

0 ) = / ^ 

’ [ {n}, otherwise. 


V 



Figure 1: The approximate projection of point v onto closed convex set K. 

As shown in Fig. 1, the cone Ck{v, 6) —v consists of all vectors having angle with the 
direction Pk{v) — v less than 9, and b(n, K) is the region on the boundary of K that the 
agent can “see” starting from point v. Obviously, the exact projection Pk{v) G P^{v,9) 
for any v G MD and 0 < 6^ < 7r/2 and P^(n, 0) = {Pk{v)}. 

Remark 3.1 The approximate projection is more “practical” than the exact projection. 
For example, a robot likes to get its exact projection point on its convex target set when it 
approaches the set. However, in reality, it may select another point on the set surface as the 
exact one by mistake or to avoid expensive measurement or tedious computation. Then 
the selected projection point becomes an approximate one. In other words, this concept 
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captures the situation when agents can only obtain some point on the set surface, which 
may not be but close to the exact projection point. Note that this concept is different from 
that given in [15], where the approximate projection point is located in a “triangle” region 
specified by v, the hyperplane of K on Pk^v) cmd the approximate angle 6. 

We next give some basic assumptions for our following analysis. 

Al (Connectivity) The switching graph is UJSC. 

A2 (Convex Sets) (i) The boundary surfaces of convex sets Xi,i = 1, ...,n are regular (or 
smooth); 

(ii) The convex set Xi contains nonempty interior points for i = 1, 

The dehnition of regularity or smoothness of a manifold can be easily found (referring 
to Dehnition 1 on page 52 in [7] for more details). Note that the Gaussian curvature of 
regular (or smooth) surfaces of closed bounded sets are bounded. In fact, A2 is quite 
mild. The boundaries of many well-known sets, such as the surfaces of spheres, ellipsoids, 
are regular; and moreover, the assumption that set A, C contains nonempty interior 
points is equivalent to dim(Aj) = m (where dim(Aj) denotes the dimension of the affine 
hull of set Xi), which was also widely used in the literature. 

Let T’^.(-) : —)■ be a continuous map with Px.{v) E P^.(f, 6*j(n)) for any v, 

where 

9i{v) = Z{Pffiv) -v,Pxfiv) -v), 

0 < 9i{v) < Ti / 2. Let 9i{y) = 0 for simplicity when v E Xi. In this paper, 9i{v) is referred 
to as the approximate angle of v onto Xi. The following assumption was used in Lou et 
al. (2014). 

A3 (Approximate Angle) There exists 0 < 6** < ti/2 such that 0 < 9i{v) < 9* for all i,v. 
Here we propose a distributed continuous-time approximate projected algorithm: 

**(^) = i^jit)-Xi{t)) + at{Pffixi{t))-Xi{t)), i = l,...,n, (5) 

where Xi G is the state estimate of agent i for the optimal solution, Mi{t) is the 
neighbor set of node i at time t, {at} is the stepsize (0 < < a*, a* > 0) and is 

uniformly continuous over t. The continuity of stepsize at and maps PxX') guarantees 
that (5) has a solution that is continuous over [0, oo) and continuously differentiable 
except at the switching moments of switching graph 

Remark 3.2 The term Pf,{x) — x can be viewed as a negative “approximate” gradient 
because it becomes the negative gradient of by noting that V|x|^, = 2{x — Pxfix)) 

in the exact projection case (i.e., Pfi^xfif)) = Px^xfit))). In fact, (5) with taking at = 1 
and exact projection was proposed in [18] to solve the CIP. 
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The convergence analysis of (5) is not easy because the gradient term is corrupted 
with state-dependent approximation and there is no explicit expression to describe the 
relationship between the approximate projection point and the exact one. To handle the 
problem, we make some transformation. In the case of n ^ Xi, we dehne by (n) the 
intersection point of the hyperplane of X, at Px^v) (the tangent plane of bd(Xj) at 
Pxi{v)) with Pxi{v) —n as the normal direction and the line segment [n, Pxi{v)], as shown 
in Fig. 2. Clearly, Pxi{v) = Pxi{v) when Px^iv) = Pxi{v)- In the case of n G X*, we dehne 
Pxii'^) ~ Pxii'^) ~ Then we can hnd that (n) = n if and only if n G Xj. We write 

where 'yx^v) = > 1 if Px^{v) 7 ^ n, and 7 Xi(w) = 1 otherwise. 

-^7. 



Figure 2: An illustration for P^,(n). 


Rewrite at{Px^ixi(t)) — Xi(t)) = ai^tiPxS^iiit)) — Xi(t)), with the virtual stepsize of 
agent i dehned as 




'lxAD{t))at 


at, 


\Pxi Ciit))-o:i(t)\ 


if P^,{xi{t)) 7 ^ Xi{ty, 
otherwise. 


Clearly, ai^t > at- Although the designed stepsize at is the same for all agents, agent i 
has its own virtual stepsize at^t based on its own approximate projection. We express (5) 
in another form with heterogeneous virtual stepsizes: 


Xi{t) = {Xj{t) - Xi{t)) + ai^tiPxii^iil^)) - D{t)),i = I, ( 6 ) 

Then we give a dehnition for our problem as follows. 
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Definition 3.2 The shortest distance optimization problem (SDOP) is solved by (5) or 
(6) if, for any initial condition Xi{0) G M™', i = 1,n, there exists x* ^ 8vcgmin.YfJ^=i\x\\. 
such that 

lim Xiit) = X*, i = 1,n. 

t^OO 

In the following three sections, we hrst establish some basic results, and then present 
the convergence results in the nonempty intersection and empty intersection cases. 

4 Discussions on Boundedness and Stepsizes 

In this section, we show the state boundedness and establish an “equivalent” relationship 
between the designed stepsize at and the virtual stepsize at^t. 

4.1 Boundedness of System States 

Denote 9i^t = 9i{xi{t)) for simplicity. Note that 9i^t is also equal to Z{Px.{xi(t)) — 
Xiit), Pxi{xi{t)) — Xiit)). Here we study the boundedness oi Xiit),i G V, t > 0 of (6) 
with the approximate angle 9i^t. 

Let Xc = co{Xi,i = l,...,n} be the convex hull of the sets Xi,i = l,...,n, f : = 
^^Vzi,z 2 &Xc \d — Z 2 \, which is hnite due to the boundedness of XjS. 

Theorem 4.1 (i) For any initial condition Xiif)),i G V, the system states Xi{t),i G V,t > 
0 are bounded; 

(a) Suppose lim inf 4^00 > 0. Then, for any 0 < 9 < 7i/2 and any initial condition 

Xi{t)),i G V, 

lim sup \xi{t) < max | f ( tan 9 + (tan 9)'^ + 2 tan 6'') |. 

Furthermore, if A3 holds, then for any initial condition Xiif)),i G V, 
limsup \xiit)\x,, < .^(tan6** + \/ (tan 9*)"^ + 2tan6**). 

t^OO 

Remark 4.1 A discrete-time algorithm was proposed in [15] to solve CIP with approx¬ 
imate projection, where 7r/4 was found to be a critical approximate angle ensuring the 
boundedness of system states in the case of ai^k = 1 and 9i^k = 9, < 9 < x/2. To be spe¬ 

cific, the states are uniformly bounded with respect to all initial conditions when 9 < n/A 
and unbounded for most all initial conditions when 9 > n/A. Different from this critical 
approximate angle result. Theorem f.l shows that the continuous-time system states are 
always bounded for any initial condition no matter how large 9 is, and moreover, the states 
are uniformly bounded for all initial conditions with fixing ai^t = 1- 
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Remark 4.2 Notice that the boundedness results in Theorem j.l do not require any 
connectivity of communication graph. Moreover, when the exact projection is obtained 
(di,t = Oj, Theorem j.l (ii) implies that all agents converge to the convex hull spanned by 
all the convex sets, which is related to the target aggregation and leader-following problems 
[13, 24, 25]. 

Here we present a result for a simple case: there is only one node in the network. Its 
set is bounded and denoted as X*. We denote the states of this node as x^{t),t > 0 driven 
by the continuous-time approximate projected dynamical system: 

x^{t) = at{Px^{x^{t)) - x^{t)), 

where G , 9^{x^{t))). Noticing that {x^{t) - PxXx*{t)), Px^{x^.{t)) - 

PxSx*{t))) < 0, we have 

^ 2(a;*(f) - Px„ix^{t)), x^{t)) < -2at\x^{t)\j^^. 

Then for any initial condition a:*(0) and any stepsize {at}, < |3:^*(0)|j\:* always 

holds. 

Now we present the proof of Theorem 4.1. 

Proof. Let t ^ A. Denote hi{t) = \\xi{t)W^, h(t) = maxi<j<„ hj(f). By Lemmas 2.3 
and 2.4, we have 

D^h{t) = max{xi{t) - Px,{xi{t)), Xi{t)) 
iex(t) 

= max {xi{t) - Px^Xiit)), 'V] {xjit) - Xi{t)) + ai^t{Pxi{D{t)) - Xi{f))), (7) 

where X{t) = {i\i G V, hiit) = h(f)}. Take i G T{t). Lemma 2.1 (hi) implies that, for any 

J, 


{xi - PxX^i),Xj - Xi) < \xi\xX\xj\x„ - \xi\xj < 0 . ( 8 ) 

According to Lemma 2.1 (i), {xt — PxXxi)iPxi{xi) — Px^xf)) < 0 due to C Xc- 
Therefore, 

{xi- PxXxi),Pxi{xi) - Xi) < -\xi\x,- (9) 

Moreover, recalling the dehnitions of Px.{xi(t)) and 6i^t, we have {xi(t) — PxAD{t)),PxSD{t))- 
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PxXxi{t))) = 0 and \P^.{xi{t)) - Pxi{xi{t))\ = tsinei^t\xi{t)\xi- Then 

{Xi{t) - PxSxiit)), Px^Xiit)) - Px^ixiit))) 

= {xi{t) - Pxi{xi{t)) + Px,{xi{t)) - PxXxi{t)),PxXxi{t)) - Pxi{D{t))) 

< \PxMiS')) - Pxlxi{t))\\P'j^.{xi{t)) - PxMif))\ 

< ^tanei^t\xi{t)\xi 

< ^tan6>i,t(|a:j(t)|xc + 0) (10) 

where the last inequality follows from the relation \xi\xi < \xi - PxXxi)\ + \PxX^i) - 
Pxi{xi)\ < \xi\x^ + Thus, based on (9) and (10), we have 

{xi{t) - PxXxi{t)),PxX^i{t)) - Xiit)) < -\xi{t)\\^ + iia.nei^t{\xi{t)\x, + Cj- (H) 

With (7), (8), (11) and i G X(f), we obtain 

D"^h{t) < + 0)- 


We complete the proof by the following analysis. 

(i) It is easy to see that for any 0 < 0 < 7r/2, 9i^t < d when \xi{t)\x^ > sin0. Then 
D^h{t) < 0 when t ^ A and 


(tan 0)2 + 4tan0N 1 

2 )/■ 

Hence, system states are bounded for any initial condition. 

(ii) Let a* = (liminft^oo ®t)/2 > 0 and t be the moment such that when t > t, 
C(i,t P Cit P Then D^h{t) < —a^h{t) once t > t, t ^ A and 


h{t) > max 


^ _ e^(tan0)^ ^ e^tan0 


2(sin0)^ 


-(1 + 


h{t) > max I ,^^(tan0)^ + tan0^1 + \/ (tan0)2 + 2tan0 


Therefore, h{t) is not greater than the number in the preceding inequality when t > i and 
t ^ A. The second conclusion can be obtained directly based on the above arguments. 
Thus, the conclusion follows from the continuity of Xi{t). □ 


4.2 Equivalence between Stepsizes 

To obtain the convergence conditions, we establish a relationship between the designed 
stepsize at and virtual stepsizes at^t- To show that they are equivalent in the sense that 
they can be bounded by each other, it suffices to establish the boundedness of 7Xi(-)- 
Let S = Xc B(0,ro), where B(0,ro) denotes the ball with center zero and radius 
ro > 0. Denote = Z(Px,(n) - P^,{v),v - PxS'>^)). 
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Lemma 4.1 If the map Px^i') satisfies 

inf fii{v) > 0, 

ves\XuP^.iv)^PxdA 

then sup^g 5 7 Xi(n) < cxo. 


( 12 ) 


Its proof is in the Appendix. The following result provides a condition to guarantee 
the condition (12). 

Lemma 4.2 Suppose A2 and A3 hold. Then (12) holds. 

The proof is also in the Appendix. Because the states of (6) are bounded by Theorem 
4.1, we take sufficiently large pq such that S contains all the system states. We next show 
that A2 and A3 imply the equivalence between {at} and {oi,*}. 

Clearly, at = at^t when Xi(t) G Xt or P^.{xi(t)) = Px^s^iit)). Then we only need to 
focus on the case when Xi(t) ^ Xt and Px.{xi(t)) ^ Pxi{xi(t)). By (39) in the Appendix, 
'jXiixiit)) < 1 + ^T^sin6>i,i, where pt^t ■= Pi{xi{t)). Then we have 

Theorem 4.2 Under A2 and A3, 

Cl C Ci^t^t C Ciat, Vt, (^^) 

where Ctt = I + sin On, Ci = 1 + 

Pi ■= inf Pit 

t>0,Xi{t)^Xi ,P^, {xi{t))^Px^ {xi(t)) 

> inf hi{v) > 0. (14) 

v&S\Xi,P-.{v)^PxAv) 

Note that the first inequality of (14) follows from Xi{t) G S and the second one from 
Lemma 4.2. In fact, (13) somehow characterizes the bounded bending property of smooth 
surfaces, which helps convert the convergence conditions on Oj ^ into the conditions on at. 


Remark 4.3 As Theorem j.2 shows, A2 and A3 guarantee the equivalence between the 
designed stepsize and the virtual stepsize. In fact, with (13), we found that under Al, the 
optimal convergence established in the next two sections hold for general convex sets (not 
necessary to satisfy A2 and A3). 
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5 Nonempty Intersection Case 

In this section, we show the convergence result in the nonempty intersection case, ^ 

0. Clearly, Xq := is the optimal solution set of min^^^j^ \A\i- 

Theorem 5.1 Suppose A1-A3 hold and fllLi ^ Then SDOP is solved by system (6) 
if atdt = oo, at tan. 9f dt < oo. Furthermore, in the special case when 9i^t = 0 
SDOP is solved by (6) if and only if atdt = oo. 

Remark 5.1 When the intersection set of all XiS is nonempty, SDOP (f) is equivalent 
to CIP of finding a point in Xq [11, 12, If, 15, 17, 18, 20, 27], The optimal consensus 
algorithm based on the exact projection presented in [18] is a special case of (5) with 
taking at = 1 and 9i^t = 0, which is consistent with Theorem 5.1. Theorem 5.1 is also 
consistent with the convex intersection computation results of discrete-time algorithms in 


[15, 20, 27[. 

Denote af = maxi<i<„ 9f = maxi<i<„ and the distance functions 



Lemma 5.1 Suppose Oif^iXi ^ 0. Then D^h(t) < 2af taa9fh(t) for any t ^ A. 
Proof. Let t ^ A. Similar to (7), we have 



D^h(t) = max 
iex(t) 


j&Niit) 


where X{t) = [i\i G V, hiit) = h(t)}. Take i G Tit). Similar to (8), we also have 

{xiit) - PxQiXi{t)),Xj{f) -Xi{t)) < \Xiif)\xo{\Xj{f)\xo - \xi{t)\xo) < 0. (16) 

From {xi{t) - Pxi{xi{t)), Px^ixi{t)) - Pxi{xi{t))) = 0, we have 


{Xi{t) - Pxo{Xi{t)), P^.{Xi{t)) - Pxi{Xi{t))) 

= {PxA^iit)) - Pxo{Xi{t)),Px.{Xi{t)) - PxXxiit))) 

< \xi{t)\xotan9i^t\xi{t)\xi 

< tan9i^t\xiit)\x^, 


(17) 


where the inequalities follow from Lemma 2.1 (ii) by setting K = Xi,y = Xi{t),z = 
Pxoixiit)) G Xi, and \xi{t)\xi < \xiit)\xo (due to Xq C Xt). Moreover, it follows from 
Lemma 2.1 (i) that {Pxi{xi{t)) - Pxo{xiit)), Pxi{xi{t)) - Xiit)) < 0 and then 


(xiit) - Pxoixiit)), PxXxiit)) - Xiit)) 


= -\Dit)\xt + (PxADit)) - Pxoixiit)),Pxtixiit)) - Xiit)) 

< -\xiit)\xf 


(18) 
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Therefore, based on (17) and (18) we have 

{Xi{t) - Pxo{Xi{t)),Px^{Xi{t)) -Xi{t)) 

= {Xi{t) - Pxo{Xi{t)),PxXXi{t)) -Xi{t)) + {Xi{t) - Pxo{Xi{t)),P^.{Xi{t)) -Px^{Xi{t))) 
< -\^iit)\xi +tan9i^t\xi{t)\x^ 

<tane^\xi{t)\x^. (19) 

From (15), (16) and (19), D^h{t) < 2ai^ttd.n6i^th{t) < 2af tan6f h{t). Thns, the 
conclusion follows. □ 


Lemma 5.2 ^ 0 and tan d^dt < oo, then lim^^oo hit) ts a finite number. 


Proof. Lemma 5.1 implies h(f) < e^-^o “7 tane+ds^^'g^ then h := supj>o is a 
hnite number. We then show the conclusion by contradiction. Hence suppose there are 
two limit points hi 7 ^ 1 x 2 of {h(f)}t>o such that limfc^oo^(Sfc) = hi and lim^^oo h(s^) = 
h 2 . Without loss of generality, we assume hi < ^ 2 . Clearly, for any e > 0 for which 
(1 + e)ihi + e) < , there is an integer Tq > 0 such that < 1 + e and 

|h(s^) — hi| < £ for A; > Tq. According to Lemma 5.1, for any t > si with k > Tq, 


; ^ 2 fT a j tan djds 

h{t) < e k 


h(sl) < (1 + £)(hi + e) < 


hi + /i 2 


< h2 


which contradicts that h 2 is also a limit point of {h(t)}t>o. Thus, the conclusion follows. 

□ 

By Lemma 5.2, if f^afi tandfidt < 00 , then the sequence {h(t)}t>o converges to a 
hnite number denoted as h*, 

lim h(t} = h*. 

t—>-oo 

Denote hf = \imsnp^^^hiit),h~ = liminft^oo ^i(A), i G V. Clearly, 0 < < h* 

for all i. 


Lemma 5.3 Suppose Al holds and 7 ^ 0. If ctfi tan 9fidt < 00 and there exists 

some node iQ & V such that h~^ < h*, then h* = 0. 

The proof of Lemma 5.3 can be completed with similar arguments in Lemma 4.3 in 
[18], which is omitted here. 

Now it is time to prove Theorem 5.1. 

Proof of Theorem 5.1. Denote afi = maxi<j<„ From (13), we hnd that atdt = 
00 , at tan 9fidt < 00 are equivalent to afidt = 00 , afi tan 9fidt < 00 , respec¬ 
tively. 

Based on the similar arguments in Lemmas 5.1 and 5.2, we can show that, for any 
z G Xq, the limit lim^^oo maxi<j<„ {xfit) — zp exists. Therefore, if consensus is achieved 
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and h* = 0, all agents will converge to a common point in Xq. Thus, it suffices to show 
that consensus is achieved and h* = 0. 


Because 



( 20 ) 


it follows that, if h* = 0, the second term on the right-hand side of (6) tends to zero as 
t —)■ cxo and then the consensus is achieved for system (6) by Lemma 2.6. Therefore, it 
suffices to show h* = 0 in what follows. 

In fact, if there is some node io with h~^ < h*, then h* = 0 from the previous statements. 
Therefore, we need to prove h* = 0 from hf = h~ = h*^\/i by contradiction. Clearly, for 
any e > 0, there is f > 0 such that when t > i, \xi{t)\xo ^ \/2h* -i- e =: <p. We complete 
the proof by the following two steps. 

Step (i). Suppose h'l = h~ = h* > 0, Vi. We claim that consensus can be achieved for 
system (6). 

We hrst show that linif^oo = 0 by contradiction. Hence suppose there exist 

io and an increasing subsequence {sfc}fc>o with lim^^oo Sk = oo such that <yio,sk\xiQ{sk)\‘x.^ > 
c for some c > 0. Without loss of generality, we assume sq is sufficiently large such that 
So >t and aj~ tan 6*^ dt < e/yj2h*. 

From Lemma 2.3, the boundedness of system states and (20), we know that \xiQ(t)\\-.^ 
is uniformly continuous on [0, oo). This along with the uniform continuity of at again 
implies that ^^so uniformly continuous on [0, oo). Therefore, there is 5 > 0 

such that — c/2 when Sk <t < Sk-\-S. Without loss of generality, we assume 

[sk, Sfe -f (5] n A = 0 for all k. We have 

Mt)\xo{\xj{t)\xo - \xio{t)\xo) - ocioADo{t)\x^^ + ai^^ttanei^ADo{t)\xo 


j&Kod) 


and then for Sk < t < Sk S, 





Q 

< (n- 1)(0- |xio(f)|xo) + tan 0+0, 


which leads to 


Xio{t)\xo < e 


(n- 



+ A 


e-(^-i)(*-*)a+tan0+ds 
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and then 


+ ^)Uo ^ C{y/^ +£) + (!- C)(^V^ + e - 2 ^^ _ ^ ^ 

where 0 < C = < 1. We can hnd that the right-hand side of (22) is less than 

\/2h* — when £ is sufficiently small, which contradicts limj^oo hjp (t) = h*. 

Thus, limt^ao Oii^t\xi(t)W. = 0, Vi From Theorem 4.2 we have 0 < < CiO*, and hence 

\imt^ooC>:i,t\^i(t)\xi = 0, Vi According to the equality in (20) and Lemma 2.6, consensus 
is achieved for system (6). 

Step (ii). Suppose hf = h~ = h* > 0, Vi We will show that liminh^oo SILi = 

0 by contradiction. 

Hence suppose there is 6 > 0 such that ^ sufficiently large t. 

Let \x{t)\xo = (|a;i(t)|xo,--, kn(t)Uo)^, vit) = (|a;i(t)|^^,..., |x„(t)|^J^, 

D{t) = diag{ai_ 4 ,..., an,t} (a diagonal matrix with diagonal entries Then by (21) we 
have 

D^\^i't)\xo < -jC.a(t)\x{t)\xo - ^D{t)y{t) + (jat tan^+l, (23) 

where is the Laplacian of graph Qa{t) with = — 1 if j ^ Afi{t), = 0 if 

j ^ i,j ^ Afiit) and = |-M(^)|- Recall that tk,k > 0 are all the switching moments 

of switching graph with tk+i — tk > t, Vi. It is easy to see that we can add some new 
“switching moments” in {tk}k>o, denoted as {tk}k>o, such that 2r > > r, Vi. 

From (23) we have 


a;(tl+i)Uo < e ^>‘>\x{t'f^)\x,+ 


^fc)| 




, ^a(t'^)Ck+i 0^ _ D{t)y{t) tan 6^1)dt. 


Note that for any s > 0, e is a stochastic matrix (with nonnegative entries and 

all row sums are ones) and the graph Ga{t'^) is a subgraph of the graph associated with 
matrix e Then applying the similar arguments given in the proof of Theorem 4.1 

in [15] we can show that liminfi^oo Ym=i l^*(^)lxi = 0- 

Then there is a subsequence {sfc}fc>o with lim^^oo Sk = oo such that lim^^oo \xi{sk)\xi = 
0 for all i. Because we have shown that consensus is achieved in Step (i), lim^^oo \xi{sk)\xj = 
0 for all i,j, which leads to limfc^oo hi{sk) = 0 for all i. Thus, h* = lim^^oo hi{t) = 0, which 
contradicts hf = h~ = h* > 0. It follows that hf = h~ = h* = 0 and then the hrst con¬ 
clusion is proved. 

Notice that ai^t = c^j^t = c^t Vz, j, t and Px.{xi{t)) = Px.{xi{t)) = Pxi{xi{t)) in the case 
of 9i^t = 0 Vi,f. Let Wi{t) = at[Pxi{,Xi{t)) — Xj(t)). Then (6) can be written as 


x{t) = ® Im)x{t) xj{t), 
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where x{t) = {xi{t), and zu{t) = [w'^it), ...,w'^{t)Y. Hence, 

where e Clearly, |CTi(r)| < and then < 

V2nh atdt. Similar to the arguments given in Theorem 4.2 in [15], we can show the 


second conclusion. 


□ 


6 Empty Intersection Case 

In this section, we discuss the convergence in the empty intersection case (i.e., = 0) 

and then show some properties of the optimal solution set in the following two subsections. 

6.1 Convergence Analysis 

The following is the convergence result for the case when = 0. 

Theorem 6.1 Suppose A1-A3 hold, Qa{t)A > 0 are undirected and = 0. Then 

SDOP is solved by system (6) if atdt = oo, a^dt < oo and attanOf dt < oo; 

Furthermore, if Oi^t = 0 \/i,t, then it is necessary that lim^^ooCtt = 0 for (6) to solve 
SDOP. 

Remark 6.1 In the case of the exact projection (i.e., Ot^t = 0), the stepsize conditions 
in Theorem 6.1 become atdt = oo and a^dt < oo, which is a continuous-time ver¬ 
sion of the discrete-time stochastic approximation stepsize condition J2T=o (^k = oo and 
YlT=o^k < given in [20] to solve the optimization problem min J2i=i fi- Therefore, 
the result in Theorem 6.1 is consistent with those in [20]. Note that ]22] proposed dis¬ 
tributed continuous-time algorithms for the empty intersection case when the graphs kept 
connected, which is more restrictive than the UJSC given in this paper. 

From Theorems 5.1 and 6.1, we hnd that the sufficient optimal consensus conditions 
are essentially different in these two cases. In addition to the conditions in the nonempty 
intersection case, the square integrability condition is usually required in the empty in¬ 
tersection case. 

Before presenting the proof of Theorem 6.1, we show two lemmas. The hrst one is 
taken from Lemma 7 in [20]. 

Lemma 6.1 Let 0 < A < 1 and {bk}k>i o positive seguence. IfYlT=ibk < oo, then 
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Lemma 6.2 Under Al, if a^dt < oo and atianOf dt < oo, then 

(yt\xi{t) — x{t)\dt < oo 

for all i, where x(t) = ^ 

Proof. Let H{t) = maxi<jj<„ \xi{t) — Xj{t)\. Since \xi{t) — x{t)\ < H(t), it suffices to 
show atH{t)dt < oo. By Theorem 4.1 (i), (5) and Lemma 2.5, for any k > 0 and t, 
kBo <t<{k + l)Bo, it holds that 



H{{k + l)5o) < ^H{kBo) + B^uikBo), 

H{t) < H{kBo) + B2u{kBo), 

for some B 2 > 0, where z/(fci?o) = atdt. Thus, with (25) we have 

00 /■(fc+l)So 


(24) 

(25) 


/.QO n 

/ atH(t)dt = 

Jo n Jk 


atH(t)dt 

at[H (kBo) + B2r'{kBQ)^dt 

HkBo) {H{kBo) + B2iy{kBo)). 


k=0 -^^^0 
°° /•(fc+l)Bo 

k=0 “'^^0 


(26) 


fc =0 


Now we estimate the term in (26). First, by Cauchy-Schwarz inequality J gig 2 < 
yfTdlT^, we have 

°o fik-el)Bo 


n 

k=0 k=0 ''^^0 

k 


aidt = Bn 


aldt < 00 . 


(27) 


Second, by (24) we have H{kBf)) < [5^H{Q) + B2'Yjr=iP^ ^z^((r — l)B^),\/k > 1. Thus, 

oo oo oo /c 

^ ( 0 ) ^ / 3 V(fcS„) + S. ^ ^ / 3 ^-V((r - l) 5 o) 


k=l 


k=l 


k=l 


r=l 


< DAAA + f f; t y-'(.=(iBo) + X-((r- 1)B„)) 


1-/3 


k=l r=l 


< tMMEi + Y. ^ f; E /5‘--'“((>' - OB, 


1-/? 2(1-/?)^ 


k=l r=l 


< OO, 


(28) 


where the second inequality follows from lo^kBo) < a*Bo, the third one from X]r=i ^ ^ 
Y^,Vfc, and the last one from (27) and Lemma 6.1. Thus, the conclusion follows from 
(26), (27) and (28). □ 
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It is time to give the proof of Theorem 6.1. 

Proof of Theorem 6.1. We rewrite (6) as 

~ + <^t{PxiiD{t)) - Xi{t)) + (j)i{t), 


where (fiit) = «t)(P^.(a;j(t))—a:j(f)). From the dehnition of P^., we have \Pxfxiit))- 

Xi{t)\ = < —L where 

^ V / I COS (ii — ms Ha + ’ 


?7 = sup{|a;i(f) - x*\, \x{t)\xi, \xi{t)\xA 

i,j,t 


is a hnite number by Theorem 4.1. Moreover, it follows from (13) that \ai^t — <^t\ < 

(29) 


(Cj^f — l)at < sin j. Then from the preceding two estimates, 

V 


< -. - at tan Oi^f 

sm /ij 

Take x* G argmin^”^^ klxr Let t ^ A. Clearly, 
d\xi{t) — 


dt 


= 2{xi{t) - x*,Xi{t)) 

= 2(^Xi{t)-x% ^ {xj{t) - Xi{t)) + at{Px^{xi{t)) - Xi{t)) + (j)i{t)y 


Because Q^p) is undirected, 
dt 

n 

=-2 ^ \xj{t) - Xi{t)\‘^+ 2'^{xi{t) - x*,at{Px,{xi{t)) - Xi{t))4>i{t)) 
j&MiO *=i 

n n 

< 2at ^ {xi{t) - X*, Px.{xi{t)) - Xi{t)) + 2 ^ {xi{t) - x*, 4>i{t)). (30) 

i=l i=l 

Then we estimate the hrst term in (30). Note that 

{xi{t) - X* , Px.{xi{t)) - PxXxiit))) < \xi{t) - x*\tan9^\xi{t)\xi < p‘^t&n9f. (31) 


We also have 

n n 

^(xi(f) - X*, Pxi{xi{t)) -Xi{t)) = -{x{t) -x*,Y^ (x(t) - Px,(x(t)))} + g(t), (32) 

i=l i=l 

where 


p(t) = ^ (xi(t)-x(t), Pxi(x(t))-x(t))-l-Y^ (xi(t)-x*,Px,(xi(t))-Pxi(x(t))+x(t)-Xi(t)). 

i=l i=\ 
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Clearly, the first term in g{t) is not greater than rj Ym=i the second term 

in git) is not greater than 27] by Lemma 2.1 (iv). Moreover, by (29), the 

second term in (30) is not greater than 2nrfattcHi6f / An. ]i_, where /i_ = mini<j<„/ij. 
Denote 'tp{t) = {x{t) - x*,^(Ci(x(t) - Pxi{x{t)))), q{t) = Qv{T.Li(^t\xi{t) - x(t)|) + 
2n?7^(l + ^7^^)«itan6'+. In light of (30), (31) and (32), we have 


dt 


.* 12 


< -2atip{t) + q{t) < c;{t) 


(33) 


because 'ijj{t) is nonnegative, following from (1) and the convexity of objective function /, 
that is. 


V'(t) = {x{t) - X*, ^Vf{x{t))) > ^{fix{t)) - f{x*)) > 0. (34) 

We next show that lim^^oo '^^=1 ki(^) ~ is a hnite number by contradiction. Let 
us suppose there exist {sa;}a:>o with —)■ oo and e > 0 such that \^i{^ 2 k+i) —x*\^ — 
Ym=i \xi{s 2 k)—x*\^ > e for all k. According to Lemma 6.2, Yl'i=i (y-t\xi{t)—x{t)\dt < oo. 
Therefore, there is iCo > 0 such that JxoJ2i=i^t\xi{t)—x{t)\dt < ^ and at tan9f dt < 
8nr;2(i+i/sin/j ) ' (33), we have that, for sufficiently large k for which t 2 k > A'o, 


< ^ \Xi{s2k+l) 


X 


* 12 


\xiis2k) 


X 


* 12 


2=1 


2=1 


< Qr] J at['^^\xi{t) — x{t)\'jdt2nr]'^ j attanOfdt 


i=l 


'Ko 


< 


e 


2 ’ 


which yields a contradiction. Hence, limi^oo l^i(^) ~ is ^ finite number. 
Thus, it follows from (33) that 


2 



at{x{t) 


- X*- PxAx{t)))) 
2=1 



-x\Vf(x{t))) 


< OO. 


Due to atdt = oo, there is a subsequence {tr-}r>o such that limr^oo {x(tr)—x*, V/(a:(A))) 
0. Since the system states are bounded, without loss of generality we assume hm,.^oo x(tr) = 
X for some x (otherwise we can further find a subsequence of {fr}r>o)- Since V/ is contin¬ 
uous, (x — X*, Vf{x)) = 0, which leads to f{x*) > f{x) -f {x* — x, V/(f)) = f{x). Thus, 

X G argmin /. 

Replacing x* with x, we can similarly show that limt^oo ki(^) is also a finite 
number, denoted as p. Moreover, the uniform continuity of at and a^dt < oo imply 
limt^oo Ot = 0. Therefore, consensus is achieved by Lemma 2.6 and then lim^^oo a;i(tr) = 
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X. Hence p = 0, which in retnrn implies lim^^oo = x for all i. Then the first part is 
completed. 

Now we show the second part. Notice that 9^ = 0 implies that = Ot Vi, j, f 

and Px.{xi{t)) = Px.{xi(t)) = PxXxi{t)). Let x* G argmin^^^j^ be the point 
with lim^^oo = X* for all i. According to the bonndedness of system states, the 
non-expansive property Lemma 2.1 (iv) and the nniform continnity of at, Xi{t) is nni- 
formly continnous with respect to time intervals {tk,tk+i), k > 0, which, along with 
lim^^oo= X*, leads to limt^oo^i(^) = 0 by Lemma 2.7. Therefore, becanse the net¬ 
work achieves a consensns, 

lim at{Pxi{xi{t)) - Xi{t)) = lim at{Pxi{^*) - x*) = 0,i = 1, ...,n. 

t^OO t^OO 

According to = 0, x* ^ Xt for at least one i. Thns, limt^oo at = 0. □ 

6.2 Optimal Solutions 

Theorem 6.1 showed that all agents consensnally converge to an optimal solntion of 
X]r=i l^lxi under certain conditions. Next, we show some properties of the optimal so¬ 
lntion set of min \^Wi^ denoted as X*. According to Lemma 2.3, the optimal solntion 
X* G X* mnst satisfy 

n n 

- Px,{x‘)) = a, 

i=\ i=l 

or eqnivalently, x* = Then we have the following resnlts. 

Before showing some properties of the optimal solntions, we give a lemma first. 

Lemma 6.3 Let K be a closed convex set in M™. Then 

(i) {y - z,PKiy) - Pk{z)) >\PK{y) - PKiz)]"^ for any y and z; 

{ii) \PK{y) - Pk{z)\ = \y - z\ if and only if y - Pxiy) = z - Pk{z). 

Proof, (i) follows from 

{y - z, PK{y) - Pk{z)) = {y- PM, PM - PM) + \PK{y) - PM\" 

+ {Pk{z) - z, Pxiy) - Pk{z)) 

> \PM-Pk{z)\" 

becanse {y - PiM, ^k(2/) - Pk{z)) > 0 and {Pk{z) - z, PK{y) - Pk{z)) > 0 by Lemma 
2.1 (i). 
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For (ii), the sufficiency is obvious. The necessity can be obtained from 

\y - PK{y) -{z- Pk{z))\^ = \y- zj^ + \Pk{z) - Px(i/)|^ + ^{y - z,Pk{z) - PKiy)) 

= 2|2/ - zj^ + 2(y - z, Pk(z) - Pk( 2 /)) 
<2iy-zi^-2lPK(y)-PK(z)l" 

= 0 , 

where the inequality follows from (i) of this lemma. □ 

Let X* be the optimal solution set of min^"^^ Then we have the following 

results. 

Theorem 6.2 (i) For any x*, y* G X*, we have x* — Px^x*) = y* —Px^y*), * = 1, •••, 
(ii) For any i, either X* C Xi or X* O Xi = 0; 

(Hi) Let X* e X*, X* ^ Xi for some i. Then X*r\line{x*, Px^x*)) = {3^*}- 
Proof, (i) Since x* = ^ and y* = \ 

F -y \ = 

< 

< 

from Lemma 2.1 (iv). Therefore, \Pxi{x*) — Pxi{y*)\ = 1^:* ~ y*\ for all L which implies 
the conclusion by Lemma 6.3 (ii). 

(ii) This is straightforward from (i). 

(hi) Let z* G X’Tl line(a;*, Pxi(a^*)), 2;* ^ x*. If z* locates the half-line with Px^x*) as 
the starting point and x* — Pxi{x*) as the direction, then Px^z*) = Pxiix*) by Lemma 
2.1 (i) (note that Lemma 2.1 is an equivalent dehnition of convex projection). Therefore, 
X* — Pxi{x*) ^ z* — PxXz*)i which contradicts what we have proven in (i) since both x* 
and 2 ;* are optimal solutions. If 2 ;* locates the half-line with Px^x*) as the starting point 
and Pxi{x*)—x* as the direction, then Px^x*) is also an optimal solution since the optimal 
solution set X* is a convex set and Pxi{x*) can be written as a convex combination of 
X*, P. Then 0 = PxXx*) — PxiiPxXx*)) 7 ^ x* — Pxi(P), which also yields a contradiction 
since both x* and Px^ix*) are optimal solutions. Thus, the conclusion follows. □ 

7 Fixed Stepsize and Approximate Angle 

In this section, we consider the constant stepsize and approximate angle case. The follow¬ 
ing result is about the convergence error between the agents’ estimates and the optimal 
point in terms of the stepsize and approximate angle. 


EhiPxAP) - PxAy*)) 

n 

Er.iXx.(x-)-Px.(y-)l 

n 

I * * I 

\x -y \ 
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Theorem 7.1 Consider system (5) with at = a > 0 and 0 < Ot^t = 9i < ti/ 2, under 
A1-A3 and that Qrj{t) is undirected for t > 0. 

(i) Suppose n^^iint{Xi) ^ 0 (implies Then 

limsup \xi{t)\xQ <\lKsnr]do( - ^BqBiC^/ l + + C tan6*+') 

t^oo y V 1 — p / 

+ ^— ^BqBiC\/1 + (tan0+)2?7Q;. 

(a) Suppose rif^iXi = 0 and f{x) = \^Wi Cstrongly convex. Let x* be the 

unique optimal solution of min f. Then 

limsup \xi{t) — x*\ <\ —- ^BoBiC\/1 + (tan6*+)^a + C tan6*+') 

t^oo y t V1 — p / 

+ ^— ^BoBlC^yl + {tan9+)'^r]a 

with S = Ac + B(0, vq), C = maxi<j<„ Ct, 9^ = maxi<j<„ 9i, Ci defined in (13), ks defined 
in Lemma 2.2, and (3, Bq and Bi defined in Lemma 2.5, where do = sup^^^ \xi{t)\xo, which 
is finite by Theorem j.l. 

Proof. Similar to (24), H{{k-\-l)Bo) < (jH^kBo) BqBiC yjl + (tan6*+)^pQ;, and then 
H{kBo) < /3^i7(0) + (1 + /3 + • • • + p'^-^)BoBiC^l + [innd+Ypa, 
along with H(t) < H{kBo) + BoBiCy^l + {tan 9~^ypa, WkBo < t < {k + l)Bo, implies 

H{t) < + (2 + /3 + • • • + P^-^)BoB^C^/l + (tan0+) V 

< ^(/ 9 ^)* + l^BoBtC^l + itnn9+yva 
(3^ 1 - P 

when /ci?o <t<[k + l)-Bo- Then 

\hnsnp H{t) < - ^BqBiC^/ l + {tan9+ypa. (35) 

t^oo 1 ~ (3 

Clearly, (5) can be written as 

Xi{t) = ^ {xj{t)-Xi{t)) + a{Pxi{x{t))-x{t))-^uJi{t), i = l,...,n, (36) 

ieMh) 

where x{t) = ^T.LiD{t), 

uji{t) = a{Pxi{xi{t)) - Pxi{x{t)) + x{t) - Xi{t)) + a{Px.{xi{t)) - Px^^iit))). 
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The first term in u}i{t) is not greater than 2aH{t) by Lemma 2.1 (iv) and the inequality 
\x(t) — Xi(t)\ < H(t), and the second term is not greater than Criata.ia9~^ due to the 
relation 

^ sin(f + ^ 1 ^ ^ 

sin/ii,4 “ sin/ij “ 

where the equality follows from the well-known law of sines: 

Oi _ 02 _ 03 

sin Al sin A 2 sin ^3 

with oi, 02, 03 the lengths of the sides of a triangle, and Ai, A 2 , A^ the opposite angles. 
Hence, 


< 2aH{t) -|- Cpa taxi 6^. 

Therefore, from (36) and the undirectedness of Qa{t)) we have 


(37) 


^ ! b ! b ^ lb 


n ^^ n ^' n 

2 = 1 2=1 2=1 

We complete the proof for both the nonempty intersection and empty intersection 


case. 


(i) If r\^^iint{Xi) 7^ 0, then, from Lemma 2.3, for any t ^ A, 


d\x{t)\ 


Xo 


2a 


dt 


n 


{x{t) - Pxoix{t)), {PxAx{t)) - x{t))) + - Pxoixit)),Y^iit)) 


2=1 


2=1 


<- \^{t)\‘xi + (4aiL {t) 2Cpa tan 6^)do 

2a 

n 
2a 


2 = 1 


<-max \x{t)\\. + {4:aH{t) + 2CpaiaYi9^)do 

n l<i<n ' ^ ^ 


< -- 


Ksn 


|a;(t)|^o -|- {AaHit) -\- 2Cpaiaxi9^^do., 


(38) 


where the hrst inequality follows from (18) (replacing Xiit) with x{t)) and (37); the third 
one from Lemma 2.2. As a result, we obtain that for any t > to ^ 0, 

rt 


\x{t)\x^ < e *°^|a;(to)lxo + 6 / e'='S"^( 4 Q;iL(s)-|-2C?7atan6'’'')(io<^’S, 

Jto 

which combines with (35) imply 

limsup |a:(t)|^ < —— -(4a^- - ^BqBiC iJl + (tan 9^Yp + 2Cpa tan 6''*'). 

“ 2q; V 1 — p / 


t—^OO 


This implies the conclusion by noticing the relation |xi(t)|xo — \x(t)\xo A \x(t) — Xi(t)\ < 
H{t) and (35). 
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(ii) If = 0 and f{x) = \^Wi -^-strongly convex, then when t ^ A, 

^ ^ {PXi{x{t)) - X{t))) + ^{x{t) - X* ,^UJi{t)) 

2=1 2 = 1 

Q/ 

< - {f{x{t)) — f{x*)) + (4aif(2) + 2Cpataii9^'jp 

cy£ 

< - \x(t) — x*P + (AaHit) + 2Cpatan.9^)p, 

2n ^ 

where the hrst ineqnality follows from (34) and the second one from (2). Thus, the con¬ 
clusion can be obtained with a proof similar to that for (i). □ 

8 Numerical Examples 

In this section, we provide an example to illustrate the above convergence results. 

Consider a network of three agents with node set V = {1, 2, 3}. The convex set Xi of 
each agent i is the ball in with center Cj and radius rj. Let at = 9i^t = which 
satisfy the conditions in Theorems 5.1 and 6.1. We next present the state trajectories 
of the three agents for the nonempty and empty intersection cases from time f = 0 to 
t = 2000 , respectively. 

(i) Nonempty intersection case with 

Cl = (-1, 0)^, C 2 = (1, 0)^, C 3 = (0, -2f, n = 2, r 2 = 1, rg = 2. 

The graphs are periodically switching over the two directed graphs Gi = (V,£^i), G 2 = 
(V, £^ 2 ) with period 1, where = {(2,1), (3,2)}, £2 = {(1)3)}. The initial conditions are 
0 : 1 ( 0 ) = (—4,3), 0 : 2 ( 0 ) = (3,5), 0 : 3 ( 0 ) = (— 6 , —3), which are marked as o in Fig. 3. 

(ii) Empty intersection case with 

Cl = (-\/3, 0)^, C 2 = (\/3, 0)'^, C 3 = (0, -3)'^, ri = r 2 = r 3 = 1. 

In this case, the (unique) optimal solution is (0, —1). The graphs are periodically switching 
over the two undirected graphs Gi = (V,Ti), G 2 = (^,£ 2 ) with period 1 , where £^i = 
{(3,2)}, £2 = {(1,2)}. The initial conditions are o:i(0) = (—3,3), 0 : 2 ( 0 ) = (4,2), 0 : 3 ( 0 ) = 
(—5, —3), which are marked as o in Fig. 4. 

9 Conclusions 

In this paper, a continuous-time method was proposed to cooperatively solve the SDOP by 
a group of agents with the help of graph theory, convex analysis and geometric technique. 
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Figure 3: In the nonempty intersection case, all agents converge to a common point in the 
intersection set. 



Figure 4: In the empty intersection case, all agents converge to the unique optimal solution 
( 0 ,- 1 ). 
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Here agents could only obtain their approximate projections and the communication graph 
among agents was UJSC. It was shown that the system states were always bounded for 
any approximate angle, and uniformly bounded for any stepsize with inferior limit greater 
than zero. Both nonempty intersection and empty intersection cases of convex sets were 
investigated with respective sufficient conditions. Moreover, the convergence error between 
agents’ estimates and the optimal point was also obtained for the constant stepsize and 
approximate angle case. 
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Appendix 


Denote 'di(n) = Z(n — Pxi{v), Px^{v) — Pxi{v)). By Lemma 2.1 (i), 'di(n) > 7r/2 when 
F^.(n) 7 ^ Pxiiv). In the following proofs, we omit all subscript i and simplify 6*j, ■dj, 

Xi as d, d, yU., X. 

Proof of Lemma 4.1. Let v G S\X and Px{v) ^ Pxic). We obtain 


7x(n) = 


P^(n) — v\ 

+ 

\P^{v) 

-pi(t,)i 


\Px{v) — n 



= 1 + 
= 1 + 
< 1 + 


\Pi(v) - P^(v)\ 


|P‘(«)-Px(t>)| 

sin(-d(n) — |) 


sin 6{v) 


sin pi{v) 

sin 6{v 


sind(n) 


sin /i(n) 

1 

< 1 + ^- -rx- 

sm pi[y) 


(39) 


Then the proof is completed. 


□ 


Proof of Lemma 4.2. Consider the following relation 


cone{v, Cx{v, 6) fl b(n, Y)) = Cx('y, 0) (40) 

where cone(n, M) = {n + X{z — n)|A > 0, ^ G M} for some set M C M"*. We hrst show 
the following three claims: 
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V 



P^{v) 


Figure 5: An illustration for the proof of Lemma 4.1. 

(i) Suppose that, for any v G bd(S'), there is 9{v) > 0 such that (40) holds for v, 0{v). 
Then (40) holds for 6* and any v G S\X with sufficiently small |n|x, 9* is the approximate 
angle given in A3. 

(ii) Suppose int(X)nhne(n, Px('i')) 7 ^ 0 for any v G bd(S'). Then the hypothesis in (i) 
holds. 

(hi) Suppose the boundary surface of X is regular. Then hypothesis in (ii) holds. 

(i) is obvious. For (ii), let 2 ; Gint(A)nline(u, Px{v)). Then there exists e > 0 such that 
B {z,e) C X. Let y G bd(B( 2 ;,e)) be the point for which — z,v — z) = ti/2. Clearly, 
(40) holds for u, 9{v), where 9{v) = — v, z — v) >0. 

We prove (hi) by contradiction. For a regular surface, its tangent plane at boundary 
point z consists of the tangent vectors at point z of all curves passing z. Suppose that there 
is u G bd(S') with int(X)nline(u, Px('y)) = 0- Then, by convex set separation Theorem 
11.3 on page 97 in [2], there exists a hyperplane "H separating X and line(u, Px(n)) 
properly. As a result, PL must contain line(u, Px(n)). Let n be the unit normal vector of 
PL with Z(n, 2 ; — Px{v)) > 7 r /2 for any z ^ X, and the tangent plane of bd(A) at 
Px{v). Then n G PL^ since v — Px{v) is a normal vector of tangent plane PLy. However, it 
is not possible that there exists a curve on bd(A) with tangent vector n at Px{v), which 
yields a contradiction. 

We now show the conclusion by contradiction. Suppose that there is a sequence {vk}k>o 
with Vk G S\X and P^(ufc) 7 ^ Pxipk) such that Imik^ooPipk) = 0. Without loss of 
generality, we assume limfc^oo'^^fc =: v* G S'\int(X). 

We hrst consider the case of v* G S\X. In the case of Px{v*) 7 ^ Px{v*), by the 
continuity we have 0 = limfc^oo Ai('t^fc) = p{v*) > 0, which yields a contradiction. In the 
case of Px{v*) = Px{v*), we have linifc^oo ^'(ufc) = 0, which implies linifc^oo'd(nfc) = 
along with limk^oo p{vk) = 0. This, however, is impossible since the surface bd(A) is 
regular. 
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We next consider the case of v* Gbd(X). Let r > 0 be a sufficiently small number 
such that (40) holds for 6* and any v + rn(n) with |n — n*| < r and v Gbd(X), where 
n(n) is the unit normal vector of the tangent plane of bd(X) at v. Denote z := v + rn(n). 
Take arbitrarily a point y := y{z) G bd(Cj)s:(z, 6^*)) fl b(z, X)naff{n, z, PJ(z)} such that 
Z(n — z,y — z) = 6*. Then 


y{z)> Z{v -y,z-y). (41) 

Moreover, it is not hard to hud that, for any zi,Z 2 such that zi ^ X, Z 2 ^ X, Px{zi) = 
Px{z 2 ), \z 2 \x > \zi\xi and with (40) holding for both (zi, 9*) and {z 2 i 0*), we have 

fd{zi) > (3 {z2), (42) 

where (j{z) = miy^hd{Cx{z,e*))nh{z,x) APx{z) -y,z-y). 

From (41) and (42) we conclude that for any sufficiently large k, 

y{vk) > inf /3(n + rn(n)) > 0, 

v£bd{X)^\v—v* |<r 

which yields a contradiction. We complete the proof. □ 
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